Computer Science - Software Engineering
Subcategories
Papers
HiRoPE: Length Extrapolation for Code Models Using Hierarchical Position
Kechi Zhang, et al. •
• (2024) • DOI:
10.48550/arXiv.2403.19115
Addressing the limitation of context length in large language models for code-related tasks is the primary focus of this paper. Existing LLMs are constrained by their pre-trained context lengths, lead...